Non-invertibility Criteria in Some Heteroscedastic Models 
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Abstract 

In order to calculate the unobserved volatility in conditional heteroscedastic time series models, the natural 



recursive approximation is very often used. Following Straumann and Mikosch ( 2006 1, we will call the model invertible 



if this approximation (based on true parameter vector) converges to the real volatility. Our main results are necessary 
and sufficient conditions for invertibility. We will show that the stationary GARCH(p, q) model is always invertible, 



but certain types of models, such as EGARCH of Nelson ( 1991 1 and VGARCH of Engle and Ng ( 1993 1 may indeed 



be non-invertible. Moreover, we will demonstrate it's possible for the pair (true volatility, approximation) to have a 
non-degenerate stationary distribution. In such cases, the volatility estimate given by the recursive approximation 
with the true parameter vector is inconsistent. 
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1 Introduction 



> 

X 



Since their introduction in the seminal papers of Engle ( 1982 ) and Bollerslev ( 1986 ) , there has been a remarkable amount 



of interest in heteroscedastic models coming from researchers in econometrics and statistics and from financial market 
practitioners. Since then, many other similar models have been introduced to more accurately reflect different qualities 
of real data. For example, various authors have proposed a vast number of volatility expressions with asymmetries 
or thresholds, non-stationarities such as unit roots or time-varying parameters, or have considered multidimensional 



extensions and non-regular time intervals. We refer to two of more recent reviews Andersen et al. (2009) and Francq 



and Zakoian (2010) which discuss these and other examples and provide the necessary references. 
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Heteroscedastic models are used to analyze and forecast the unobserved volatility of different financial time series. 
It is common to construct predictions for current and future volatility values using a natural recursive volatility approx- 
imation. Let us recall its definition for a general conditional heteroscedastic model. We define such model as a solution 
of 



Vt = GtSt, 



°t = H (9>Vt-i, ■ ■ ■ >J/t-p,CTf-i, ■ ■ ■ er t 2 _„), t6Z, 



(1) 



where {j/t} is the return process, {at} is the volatility process, H is a known function, p, q G NU {0}, 9 is the parameter 
vector taken from a set OCR' and {st} are i.i.d. random variables on a probability space (17, J- . P). More general 
versions of (|lj) are of course possible. Assume that y\- v , ■ ■ ■ , y n are observed, fix s 2 G R + and define the recursive 
volatility approximation by 



<) = s 2 , t=l 



.0. 



a*(9')=H(9 , ,y t - 1 ,...,y t - p ,al 1 ( 



't-q\ 



?')), t>0. 



for any G O. The quantity 



(2) 



is often used as an estimate of the volatility value at n, where 9 n is any consistent estimator of 9. There are other 

( 1996 1 suggest using the sample mean of y\_ v , ■ . ■ , y 2 as a starting 



possible definitions of a 2 . For example 



Baillie et al. 



point instead of s 2 . 

In order for approximations ^ to be consistent, it is natural to at least expect that the approximation a 2 (9) (using 
the true parameter vector) converges to the unobserved value a 2 : 

\a*(9)-a 2 \$0, t^oo. (3) 

To describe models with property we'll re-use the following definition from Straumann and Mikosch (2006): 



Definition 1.1 Assume for all 9 G 6 the model £7p has a strictly stationary solution and is true for any initial 
point s 2 . Then we say the model has the property of invertibility. 

Note that many estimator types and tests are very commonly considered under the assumption of invertibility. 



Indeed, such estimators as the popular quasi-maximum likelihood estimator (QMLE) of Lee and Hansen (1994) and 



more recent GMM-type robust estimators of Boldin ( |2000 ) or minimum distance estimators as in Sorokin ( 2004 ) as well 
as many others are based on residuals {yt/o~t(9')}. Their asymptotic properties are commonly established assuming 
convergence of residuals, therefore under invertibility. The same assumption is used for popular tests types such as 
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goodness-of-fit and dimensionality tests (see Francq and Zakoian (2010)) and structural break tests (Boldin (2002), 



Horvath and Teyssiere (2001)). Therefore, the issue of non-invertibility is key for such procedures. The notable 



exception are estimators based on autocovariance function such as Whittle estimator applied in Giraitis and Robinson 



(2000 


) and 


Zaffaroni 


(2008) 



For linear time series models such as ARMA the notion of invertibility is classic, see e.g. |Brockwell and Davis| 
(1991). For non-linear models, however, there seem to be more than one possible definition. The definition [O] is based 



on that of Granger and Andersen (19781. For detailed discussion and some further references, see Straumann and 



Mikosch (20061, subsection 3.2. A related definition of invertibility, in particular for bilinear models, was considered 



previously in |Tong (1990). According to Tong's definition, the model ([l} is called invertible if St is a.s. a measurable 
function of (. . . , yt—iiVt—XiVt) for any t 6 Z. We'll refer to this notion as global invertibility (this is in contrast to 
local invertibility, see the next paragraph) . Recently, there have been some further results on invertibility of non-linear 



(2005 


) and 


Ling et al. 


(2007) 



ARMA (NLARMA) models were discussed in Chan and Tong (2009). 



The main goal of this paper is to show that some heteroscedastic models (for example, EGARCH of Nelson ( 1991 ) and 



VGARCH of Engle and Ng (1993)) may in general be non-invertible, even if the model has a strictly stationary solution. 
Moreover, we will provide necessary and sufficient conditions for invertibility for such models. We will demonstrate 



that if a model is locally invertible (see Definition 2.5 below, also Chan and Tong (2009) for the similar definition), it 
is also invertible. On the other hand, we'll prove that under a slightly more restricting condition than a lack of local 
invertibility the model is also non-invertible. Moreover, we will show that on an extended probability space there exists 
a random variable £, independent with a{et, t > 0}, such that for s 2 = £ the process 

is stationary but 

P(a 2 t = a 2 t {6)) = 0, t>0. 

To the best of our knowledge, this is the first use of the notion of local invertibility in the literature on heteroscedastic 
models. Its usefulnes is that it's much easier to check that invertibility itself, this will be discussed below. The used 
method is general and may be applied to many other heteroscedastic models. 



The rest of the paper is organized as follows: in the subsection 2.1 we provide necessary definitions and discuss 
non-invertibility in more detail. The main results of the paper are given in the section [3] As a fact of independent 
interest and an illustration of non-invertibility, we provide the results of numerical simulations showing that it is possible 
to have deterministic chaos (in the sense of Devaney (1989)) in EGARCH in subsection 3.2 Finally, section [4] contains 
proofs. 
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2 Prelimiaries 



2.1 Stationarity and Invertibility 



Let us recall the definition of the GARCH(p, q) model of Bollerslev (1986). It is defined as a solution of particular case 
of with I = p + q + 1 and 



y t = a t e t , 



of = a + aiy 2 _ 1 + ... + a p y 2 _ p + /3iof_j + ... + P q a 2 _ q , t G Z, 



(4) 



where 



9 = {a >0, on > 0, i = l,...,p, Pj>0,j = l,...,q}. 
We'll be interested in the strictly stationary solution of Q. The necessary and sufficient condition for the existence and 



uniqueness of such a solution was found in Bougerol and Picard (1992b). For simplicity, let's consider a case p = q = 1. 
Then the condition reads 



Condition 2.1 



£;iog(aie^ + /?i) < 0. 



Here and in the rest of the paper we denote the natural logarithm log. 



It is easy to see that in GARCH(1, 1) model strict stationarity implies invertibility. Indeed, Condition 2.1 implies 
that Pi<l. Then 



therefore 



\a 2 (6)-a 2 t \ a -4-0, t^oo, 



implying invertibility. Using the multidimensional version of Condition 2.1 one can check that the same implication is 
also true for the general GARCH(p, q). 

However, the stationarity does not imply invertibility for other heteroscedastic models. Notably, it turns out this 



relation fails for the EG ARCH model of Nelson ( 1991 ) and the VGARCH model of Englc and Ng ( 1993 ). For simplicity, 



we'll consider only 1-dimensional models of those types. 

The general model for the 1-dimensional case may be written as 



Vt = o- t e t , 



o] = H(0 1 y t _ 1 ,a 2 _ 1 ), teZ. 



(5) 
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Definition 2.1 EGARCH is defined as a solution of 



y t = a t e t , 

(6) 

loga 2 = a + 7 |e t _ 1 | +fc t _! +^logfi t 2 _ 1 , t E Z, 
where 8 = (a,/3, 7 , <5) is the parameter vector and {et} are i.i.d. 

Definition 2.2 VGARCH is defined as a solution of 

Vt = o- t s t , 

(7) 

of = a + 7(e t _i-<5) 2 + ( 3of_ 1 , teZ, 
where 8 — (a,/3, 7 , <J) is the parameter vector and {et} are i.i.d. 

In order to make the models meaningful, we need to enforce certain restriction on parameter values. For EGARCH, we 



assume that 7 > \S\ (see Straumann and Mikosch (2006), p. 20 for discussion of why this is reasonable, note somewhat 



different notation) and that f3 > 0. For VGARCH, we demand that a > 0, (3 > 0,7 > 0. 



It follows from the Theorem 2.5 from Bougerol and Picard (1992a) that a necessary and sufficient conditions for the 



existence of a strictly stationary solution to ^ and ^ are given by 
Condition 2.2 

£ , log|a + 7 |e | +5e \ < 00, p < 1. 

Condition 2.3 

£log(a + 7 (£ ~S) 2 ) < 00, ( 9<1. 

respectively. We will assume these conditions to hold throughout the rest of the paper, and denote the stationary 
solution of either ^ or ^ by {a t }. 

The issue of invertibility is, however, more complicated. First, let's consider the explicit expressions for <r 2 (#). Since 
the sequence of random variables {e t } is unobservable, it needs to be approximated. Commonly this is done using the 
residuals 

i t (6')=y t /6- t (6') 



For EGARCH, we define 6 (&') recursively as a solution of 



loga 2 (0') = s 2 , t = 0, 



(8) 

log«r 2 (#') = a' + /3'log<7 t 2 _i(0') + l'\it-i(0')\ + fit-itf), t > 0. 
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For VGARCH a 2 {6') are given by 



) = a! +[3'a 2 _ 1 {0')+ 1 '{e t - X {9')-5') 



'\2 



t = 0, 



t > 0. 



(9) 



In both cases, we have 



a 2 t {9') = jUOx^')), *>0, 
where {/*(•)} is a sequence of random transformations K + — > M + , defined for the general model ^ by 

f t {x) = H{6,y t ,x), teZ,xeR+. 

Crucially, the random transformations defining {of} (cf. (Jf)]), (|7|) and those defining {of (#)} (cf. Q) arc different. 
Indeed, for the general model ^ we have 



of = H(6,(x t - l e t - 1 ,a1_ 1 ), 



t > 1. 



(10) 



Note that the right-hand side of the second equation in (10 1 depends not only on o'(_ 1 (0), but also on af_ 1 . 



For a general heteroscedastic model invertibility holds if the top Lyapunov exponent of the corresponding sequence 



{it(')} is negative (Proposition 3.7 of Straumann and Mikosch (2006)). Let us recall the definition of Lyapunov exponent 
of a family of transformations: 



Definition 2.3 Assume {/t(')}tGZ is a stationary ergodic family of I 

£logA(/ t ) < oo, 



functions, such that 



where A is the Lipchitz norm, 



Then the quantity 



A(/) := sup 



\m-m\ 



A = inf <^ E 



1 



t + 1 



^ y \x-y\ 



logA(/ t o...o/ ) ,t 6 N 



is called the top Lyapunov exponent. 

However, estimating top Lyapunov exponent for nonlinear systems is not straightforward (and therefore checking 



whether the sufficient condition for invertibility holds is hard, p. 21 of Straumann and Mikosch (2006)). Note that the 
second equation of (10) could be nonlinear in a 2 _ 1 (8) even if the first one is linear! Therefore, the results of Bougerol 



and Picard (1992a) are not applicable. To the best of our knowledge, necessary and sufficient conditions for invertibility 



of such nonlinear models are not known. 
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We will consider a simple lower bound for the Lyapunov exponent which will be useful for the construction of a 
criteria for invert ibility. From now on, we will write of instead of of (0) for brevity. 

Definition 2.4 Assume that the equation ^ has a unique stationary solution {of}tgz- Assume also that for any fixed 
9 G 9 the function H(6,-,-) is continuously differentiate. Denote 



1 



(ft ° ■ ■ ■ ° fo) 



logA y t ) ,t g N 



t + 1 

We will refer to X y as stability coefficient and call a heteroscedastic model locally invertible if X y < and locally 
non-invertible otherwise. 



A similar definition for non-linear ARMA models was considered in Chan and Tong ( 2009 ) . 

Unlike top Lyapunov exponent, X y may be written down explicitly using the chain differentiation rule. Denote 



U x (V,y,X) - 7^ : 



then 



therefore 



A y = 



d 



~ T =(7 



(ft ° ■ ■ ■ ° fo) 



f[\H' x (6,a k s k ,a 2 k )\, 

fc=0 



If the process {a\ } is ergodic and 

due to Birkhoff-Khinchin ergodic theorem 



t 

logA^^log|^(0,o fe£fe ,o2; 

fc=0 



Also note that since 



it must also be that 



£log \H' x (9,a e ,o-l)\ < oo, 



\y = E log \H' X (6, a e ,a 2 ) 



A?<A(/ t o...o/ ), 



\ y < x. 



ai) 



The quantity X y has an intuitive interpretation. It indicates whether the behaviour of of is convergent or explosive in 
the neighborhood of the true volatility value o-\ (this will be formalized in Theore 
([5]), three cases are possible: 



reins 



3l]-[3!4|. For the invertibility of 



1. If X v < X < 0, u\ is stable and invertibility takes place (see Straumann and Mikosch (2006), Theorem 2.8). 



2. If X y < < A, Theorem 2.8 of Straumann and Mikosch (2006) is not valid anymore. The behaviour of of is 



"stable" in the neighborhood of the true volatility value of . 

3. If < X v < X, the behaviour of of is explosive in the neighborhood of the true volatility value of. 



Definition 2.5 Assume that the system (10) has a stationary solution (of ,<7 t )t>o on an extended probability space such 
that 



- 2 



Then we call the model |5|) properly non-invertible. 

It is interesting that the unstable assumption of case 3 is (under mild technical conditions) sufficient for the proper 
non-invertibility for EGARCH and VGARCH models. On the other hand, in case 2 if we only assume that X y < 0, both 
models are invertible. These are the main results of this paper, to be considered in the following section. In addition, 
we show that in both cases for any starting point s 2 the sample distribution of 



^ti^t)) t = Q,...,n 



converges to the stationary one. Together with proper non-invertibility it implies that the approximation of is incon- 
sistent if A y > 0. 



3 Main Results 

Before we formulate the main results, let's introduce the conditions to be used. First one is a regularity condition. 

Condition 3.1 The distribution of eo is absolutely continuous with respect to Lebesgue measure on K with continuous 
density g(x), Esq — 0, Ee\ = 1 and 

g(x) > Vx G E, sup(|x| + l)g(x) < oo. 



Condition 3.1 may probably be somewhat relaxed, although a condition similar to g(x) > is essential in establishing 
the i/>-irreducibility of relevant Markov chains, see Proofs section. 



We will formulate the assumption on X y using the equation (11). Denote X y E and Xy stability coefficients for 



EGARCH and VGARCH respectively. Note that for EGARCH due to ^ 

H E (9, y, x) = exp {a + /3 log x + ( 7 |y| + Sy^ 1 / 2 } , (H E )' x (6, y, x) = H E (9, y, x) (px" 1 - ( 7 |y| + 5y) X -^ 2 /2) , 
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and by definition of the stationary solution at 

X y E = Slog \H E (fi,a e ,o$)\ - Slog \a 2 \ + Slog \f3 - ( 7 |a £o| + Sa e )<j^ /2\ = 

Slog|/3-2- 1 ( 7 | £o |+fe )|. 

For VGARCH due to @ 

H v (9, y,x)=a + l3x + ^yx^ 2 - Sf , (H v )' x (9, y,x)=f3- ^x^^iyx^l 2 - 5) 



and 



\ v v = E log \(3 - -fa e <T (a e a - S) \ = E log \(3 - je a (e - S)\ 



3.1 Invertibility criteria 

Now we will formulate the main results: 



Theorem 3.1 (Proper non-invertibility for EGARCH) Assume the Conditions 2.2 and 3.1 hold and \ V E > 



- 2, 



Then the system (10) with H = H has a stationary solution {(07 , o~ t )}t>o on an extended probability space such that 



P(a 2 = W ) = 0. 



Theorem 3.2 (Proper non-invertibility for VGARCH) Assume the Conditions 2.3 and 3.1 hold and X v > 



Then the system (10) with H = H v has a stationary solution {{a 2 , a t )}t>o on an extended probability space such that 



P(a 2 = W ) = 0. 

Besides the proper non-invertibility, another important question is the joint behaviour of the true volatility a 2 and its 
approximation a 2 . As it turns out, the sample distribution converges to the stationary one: 



Theorem 3.3 (LLN for {(of, of)} in EGARCH) Assume the conditions 2.2 and 3.1 are fulfilled 



i) If \ V E > 0, the process {(o~ 2 ,o~ t )}, the stationary solution of (10) with H = He, is ergodic and for any B G B(M. 2 
and starting point s 2 

n-l 

n- 1 J2 H(o-l<J 2 ) e B} a 4- P((al^ ) S B), oo, 
t=o 

where /{•} is the indicator function. 

ii) If \ V E < 0, for any starting point s 2 and [i > 



p(\4-cjI\ >ii)->o. 
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Theorem 3.4 (LLN for {(of, of)} in VGARCH) Assume the conditions 2.2 and 3.1 are fulfilled. 



i) If Ay > 0, the process {(o~ 2 ,o~ t )}, the stationary solution of (10) with H — Hy, is ergodic and for any B £ 
and starting point s 2 



n-l 



" x e B} °4- P{{al%) € B), 



t=0 

ii) If Ay < 0, for any starting point s 2 and \x > 

Theorems |3 . 1 1 - [3 . 4| indicate that for some parameter vectors finite sample volatility approximations do not converge to 
the actual volatility as the sample size increases. In particular, the standard recursive volatility estimator is inconsistent 
(this is easily checked by setting 

B = {(a 2 ,a 2 )eR 2 + : \<J 2 - a 2 \ > fi} 



for a (J, > and applying Theorems |3.3| and |3.4[ ). 

The general heteroscedastic model ^ considered in this paper can be re-written as a particular case of NLARMA 



model (see Chan and Tong (2009), Equation (3)). The issue of invertibility then also becomes a special case of 



invertibility of NLARMA. However, the latter paper discusses only local invertibility for such models. Therefore, 



our results complement Chan and Tong (2009) since we establish that local invertibility is (except the case X v = ) 
equivalent to invertibility for particular cases of NLARMA. It would be very interesting to investigate global invertibility 
of heteroscedastic models such as EGARCH and VGARCH. It easy to see that a stationary invertible model is necessary 
globally invertible. Indeed, denote for any t £ Z, k > 1 

*lk,s* = H(6, y t -i,H(6, y t _ 2 , . . . H{6, y t -k, s 2 ) . . .), 
so that a 2 = a 2 t s 2- Then due to invertibility 

-2 p 2 



as k 



and for some sub-sequence {k n } 



a.s 2 



t,fe„ 



as n — > oo. The reverse relation seems more complicated and is left for future research. 

Another problem (which also will not be considered here) is the behaviour of tests and estimates unver non- 
invertibility. Commonly, consistency and asymptotic normalilty are established under invertibility assumption. However, 



it was shown in Zaffaroni ( 2008 ) that the Whittle estimator (which is not residual-based) remains asymptotically normal 
under non-invertibility too. It will be interesting to see what happens to common estimators such as QMLE. 
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Finally, it is possible in principle that the conditions ensuring the existence of the stationary solution and the lack 
of stability are mutually exclusive and therefore the Theorems |3. 1| - [3~4| are vacuous. However, it is easy to check the 



opposite (see also the Figures 3.1 and 3.2). 



For EGARCH, we'll show that for any distribution of {eo} satisfying Condition 3.1 there exists 9, such that the 
Condition 2.2 is satisfied and A*^ > 0. Indeed, the Condition 2.2 is satisfied if j3 < 1 and i?|log|e || < oo. Condition 
|3 . 1 1 ensures that the latter holds. It therefore suffices to choose arbitrary a>0, /3<1, 5 = and large enough 7. 



For VGARCH we'll only check a more relaxed statement. Assume in addition to Condition 3.1 that there exists 
/ieR, such that 

Elog|e -j"| < £log|e |. 

As a particular example of a distribution with such property, it suffices to choose a unimodal non-symmetric distribution 
with a maximum not at 0. For example, an appropriately scaled mixture of £1 and —£2, where both £1 and £2 had 
exponential distributions but with different parameters, is one such distribution. 
Put (3 = and select arbitrary 7 > 0, a > and 6 = /i. Then 

7£ (eo - A*) 



al = a + 1 {e^-^)\ (H v )' x 
Due to dominated convergence theorem, when a — > 0+, 



a + 7(e_i - fi) 2 ' 



Slog|/3-7e o- 2 (eo-/i)| =£log 



7£ (eo - M) 



Slog 



£0 



a + 7(e_x - fi) 2 
= £log|£ |-£log|£-i-Ml >0 



£_1 - (J, 

For arbitrary 7 and a and /? small enough, Ay > 0. 

To illustrate the main results, we show the figures demonstrating the behaviour of instability coefficient X y and 
sample paths of models Q and ([7|. 
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Figure 3.1: Heatmap of X V E and Ay. Positive values correspond to non-invertible models. For EGARCH, we used 
a = 0.1, 13 = 0.25, 7 = 5.4 and standard normal ei. For VGARCH, we used a = 0.001, (3 = 0.01, 5 = -0.3, 7 = 1 
and E\ was an appropriately scaled mixture of £x and — where both ^ and £ 2 had exponential distributions with 
parameters 1 and 4. 




t t 
12 

Figure 3.2: EGARCH and VGARCH simulation results. The top plot shows simulated of as a function of t. The 
bottom plot shows the difference (of — af) as a function of i. 



3.2 Deterministic Chaos in EGARCH 



We'll discuss a simple case of deterministic EGARCH model, which sheds light onto the origin of non-invertibility in 



this particular model and also on the intuitive sense of local invertibility. Assume that the Condition 2.2 is satisfied and 



then 



P( £l = 1) = P(e 1 = -1) = 1/2, /3<1, 6 = 0, 

loga? = lo g( 7 2 = ( a + 7)/(l-/3), 
dt = f(dt-i), f{x) = a + f3x + ie - dt - l/2 , d t = loga { 2 -loga t 2 , t e Z. 



(12) 



(13) 



We don't pursue the task of the formal proof, but numerical simulations show that the dynamical system given by / of 



( 13 1 is chaotic in the sense of Devaney once 7 is large enough. More precisely, when 7 increases, the system experiences 



period-doubling bifurcations and eventually becomes chaotic. 



The bifurcation diagram of (13) is shown at Figure 3.2 As discussed in Devaney (1989), the period-doubling 




Figure 3.3: Deterministic EGARCH bifurcation diagram for a = 0.2, (3 = 0.5. 



behaviour is typical for maps 



For example, the famous logistic map x i— > 72; (1 — x) exhibits the same type 



of bifurcations. It is also quite interesting that under ( 12 ) the local non-invertibility of EGARCH is equivalent to 



instability of log?? 2 which is the only fixed point of /. If this point was stable in the sense of \ V E < 0, there would be at 
least an interval of stable behaviour. In the general "stochastic" case, discussed in the previous subsection, the stability 
is equivalent to invertibility with the exception of the case X v = 0. 
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4 Proofs 



4.1 Markov chain foundations 

In this section, we'll present the proofs of Theorems |3 . 1 1 - [3~4) The main technical tool used is the general result stating 



the existence of a stationary distribution in Markov chains (Theorem 10.0.1 of Meyn and Tweedie (20091), we'll re-state 
it for convenience. We also re-use some notation and definitions from the book. 

Assume that {<&t}t& is a Markov chain with a polish space X as state space, transition probabilitites P(x, A), x G 
X, A £ B(X), is a measure on B(X). Also fix {aj} - a distribution on N + . Denote 



t A = inf{* > : $ 4 € A}, J)4=^J{$ i eA} 1 



t>i 



Px(-) = P(-|*o = a), = £[-|*o = 4 

= P x {t a < oo). 



Denote ^ the maximal irreducibility measure (see (Meyn and Tweedie 2009 Proposition 4.2.2)), 



B+(X) = B(Af) : tf>(B) > 0}. 



Theorem 4.1 (Theorem 10.0.1 of Meyn and Tweedie (2009)) If the chain 4> is recurrent then it admits a unique 
(up to constant multiples) invariant measure it. This invariant measure is finite (rather than merely a -finite, and there- 
fore the chain is positive ), if there exists a petite set C such that 



sup E x [t c ] < oo. 

x£C 



(14) 



4.2 Proofs of Theorems O and ET21 

The proofs of these two theorems will follow exactly the same recipe. In Step 1, we establish the following drift criteria 



from Meyn and Tweedie ( 2009 ) for a certain set C: 



Definition 4.1 (Strict drift towards C) For some set C G B{X), some constants b < oo and fi > and an extended 
real-valued function V : X — > [0, oo] 



AV(x) < -fil{x i C} + bl{x EC}, xe X, 



(15) 



where 



AV(x) = E x [V($ 1 )]-V(x), xeX. 
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In Step 2 we'll check that the chosen C is petite. 



In Step 3 we check the condition (14) and ^-irreducibility of {$ t }, using the strict drift condition. 



Finally, we establish that the appropriate Markov chain is indeed recurrent using the following slightly modified 



version of Theorem 8.4.3 from Meyn and Tweedie (2009): 



Theorem 4.2 Assume that {$t} is ip -irreducible and there exist a petite set C and a function V which is unbounded 
off petite sets (in the sense that Cy(n) = {y : V(y) < n} is petite for all n), such that <J> has a strict drift towards C . 
Then L(x, C) — 1 for all x € X and $ is recurrent. 



The recurrence of {<&t} and Theorem 4.1 imply the existence of the stationary distribution tt, and finally the equation 



( 14 ) ensures n is finite. 

Throughout the proofs we will denote ob(1) (Ob(1)) a function of B which converges to (is bounded) as B —> oo 
and model parameters and the distribution of So are fixed. 
Proof of Theorem [331 

First of all, note that the equation Q together with (|6| are equivalent to 



z t = a + Pzt-i + j\st-i\ + fet-i, 

z t = a + fizt-i + (7kt-i| + Se t -i) exp{-d t _i/2}, 



t > 1, 



(16) 



where we define 



z *= lo gof, i* = log of (0), d t =z t -z t , t>0. 
It is more convenient to instead consider the chain {(zt,dt)} defined by 



where for brevity we put 



denote for x G 



and recursively define 



z t = a + /3zt-i + e|_!, 

tk = pdt-i + £?_ 1 (exp{-(i i _i/2} - 1), 



s* t = j\s t \ + 6e t , t>0, 



e x = exp{— x/2} — 1, x + = max(x,0) 



t > 1, 



(17) 



hi(z,x) = a + (3z + x, h t (z,xi,...,xt) = hx(ht-i(z,xi, . . . ,x t -i),x t ), t>2, 
hi(d,x) = [3d + xe d , h t {d,xi, ...,x t ) = hi(ht-i(d, x\,... ,x t -i), x t ), t > 2, 
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so that 



z t — h t (z 0l £q, . . . , £{_i), rft — ht(do, Eq, . . . , 



It is easy to see that for any d 7^ and t > under Condition 3.1 P( z ,d){dt = 0) = 0. Indeed, due to Condition 3.1 
P(sl = x) = for any x 7^ and 

(di = 0) = P (M) (/3d + s* Q e d = 0) = P M (eS = -/3d eJ l ) = 0. 

For an arbitrary t > we get the result by induction and Fubini theorem. From now on we will consider the modification 
of the chain {(z t ,d t )} on the space 

X E = R x (R\{0» 

(which exists as we've just shown). 
Step 1. Put for some k > 



V E (z,d)=R(d) + k\z\, R(d) = < 



-d-1, if d < — 1 
-log|d|, if \d\ < 1 . 
log d, if d > 1 
C E (yl, B) = {{z, d) e X E : < |z| < A, \d\ > B~\ \d\ < B] 
We'll first show that for some /j, > and all (z, d) € Xe\Ce{A, B) 

E{ z ,d)[VE{zi,di)] < V E (z,d) - fi 

if A and B are large enough. Indeed, 



(18) 



E z \ Zl \ < |a| + 0\z\ + E\e* \ < B (1) + p\z\. (19) 

Note that the conditions X V E > and 7 > |<5| ensure that 7 > 0. For d > B and B > by the definition of P and 
Lemma 4.1 ( a]) 

E d R{d x ) = E \og(!3d + e* e d )I {di > 1} + 
E[-\og\pd + ele d \]l{\d x \ < 1} + 
£H3d-efa,-l)J{di <-l} < 
P(d x > l)\og(pd)+o B {l) + O B {l)Ee* P(d l < -1) < logd + log/3 + o B (l). (20) 



For d < — P, once again using definition of R and Lemma 4.1 (bh, we get 



^d-R(di) = E{-Pd - e* e d - l) J {di < -1} 



1G 



E^-log^d + e^lUdil < 1} + 
Elog^d + e^Iid, > 1} < 
-0dP{di < -l} + log(-/3d)P(|di| < l)+log(exp{-d/2})+i;iog + (^) + O s (l) < 

-d/2 + B {\). 

For d E (0, B^ 1 ) 1 using Taylor's expansion we find that for any p > 

E d R{d x ) < E(-pd - e e d - l)l {d x < -1} + 



E\og\pd + e* e d \ < 
< {-e d )Ee* - logd+ sup E \\og\/3 - x2^ 1 e^\\ + o B {l). 

sB6(l-p,l+p) 



(21) 



(22) 



Using condition A^ > and the dominated convergence theorem, we infer that for some jj. > and £? large enough the 



right-hand side of (22 1 is no more than 



log d— jj,, p > 0. 



The case d e (— B 1 ,0) is similar. 



It is now enough to notice that equations (19) - (22) indeed imply (18). 



Step 2. We'll show now that for some \i > 0, D the sets C E (A,B) are ^-petite for the chain {(z t ,d t )}, a = 
(0,1/2,1/2,0,...) and 

dv = fil{(z,d) E Z E }dX E , Z E = [D,D + fi] x [D,D + 

where X E is the Lebesgue measure on X E . It will also ensure that V E is unbounded off petite sets, since it easy to see 
that sets of form {V E (z, d) < x} are subsets of C E (A, B) for large enough A, B. 
First, consider the case d > 0. We'll use the Lemma [4. 2| with 



k = 2, T = {z,d),T=C+(A,B) = C E (A,B)n{d>0}, Z = Z E , 

f(z4){xo,xi) = (h 2 (z,x ,x 1 ),h 2 (d,x ,x 1 )). 
The only non-trivial part is checking that once D is large enough the equation 

h 2 (z,x ,xi) = z* , h 2 (d, x , xi) = d* 



(23) 



on Xo and X\ has a solution for any (z*, d*) € Z E and {z, d) £ C^(A, B). The z part of (23) is equivalent to 



z* = a + j3(a + flz + x ) + xi, 
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which is satisfied if and only if 



where we put 



x = p 1 (S ~ xx). 



S = z* — a — /3(a + pz). 



Then for xo = 5/(2/3), x\ = 5/2 the z part of (23) is satisfied and for large enough D we have 

h 2 (d, 5/(2/3), 5/2) = (pd + x a e d ) + x x ^ d + x ° e ^ 2 - l) > 
p 2 d + Se d /2 + (5/2) ( e -(*H- ed s/(2«)/2 _ i) > (5/2) f e -e- 1/l3B) s/4p-pB/2 _ 2 )>D, (24) 
where we used the definition of Ce(A, B). On the other hand, if Xq — /3, xi — S — /3 2 and D is large enough 

h 2 (d, 0,S)=p ((3d + x Q e d ) + Xl (e-W+*oe d )/2 _ ^ = 
/3 2 d + (5 - /3 2 ) (e-^/ 4 - l) < /3 2 d + (5 - p 2 ) (e^ B ~ X ^ - l) < 0. (25) 



From (24) and (25) and continuity of h 2 we conclude that for some X\ — x\ <E [5/2,5] and Xq ~ /3 1 (5 — x^) (23) is 
satisfied. Lemma 



4.2 



implies that C E (A, B) is petite. The fact that C E (A, B) = C E (A, B)C\{d < 0} is petite is proved 



by using Lemma |4.3| with 



fc = 2, n = (z,d), t 2 =, Ti = Cz{A,B), Z = Z E , T 2 = K, T = C £ ( J 4,B)x 



£ = ( £ *) £ 2)i X = £o> /((MW^i^a) = (M^o, xi,x 2 ), h 3 (d,x ,Xi, x 2 )). 

The technical details are omitted as they are similar to the above case. The set C E (A,B) is petite as a union of 
C+(A,B) and C E (A,B). 



In order to ensure the strict drift condition (151, it only remains to show that 



sup (E( Ztd )[V E (zi,di)] - V E (z,d)) < 00. 



For z part of V, 



sup (E z \zi\ - \z\) = sup (a + P\z\ + E\eq\ - \z\) < 00. 



For d part, it is achieved in a similar fashion to the proofs of (19) - (21). Thus, the correctness of (15) is established 



Theorem 4.2 implies that the chain {(z t , d t )} on the space X E is indeed recurrent. 



Step 3. Let's check now that (14) takes place with $^ = (zk, dk) 1 C = C E (A, B) and A and B large enough. Put 



h = {(z k ,d k ) € C E (A,B), (zi,di) i C E (A,B), i = 1, . . . , k - 1}, x = {z,d) 
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and note that due to ( 18 ) and law of iterated expectations 



oo > e x [v e ($i)] > E x \y E ($i)i{$i i c}\ > e x [(v e {*2) + i c]\ > 

»P x {$i iC) + E x [V E ($ 2 )I{$i £C^ 2 £ C}} > 

tiPA^i £c) + /iP x ($ 2 i c, $! i c) + e x [v e ($ 3 )i{$i £c,^ 2 £ c, $ 3 i c}\ > 

nJ2 p *(®i iC,...<$> k £C)> i C, . . . $ fe £ C, eC) > 

k>l k>l 

»(E x [t c ] - 1). 

We'll now prove that for some D, fj, > the chain $ is ^-irreducible with 



Indeed, for any x £ Ce(A, B) and G £ Z E 



hence for any x £ Ce(A, B) and G C Zg; 



HI{Z E }d\ E - 



P*($ 2 € G) > a*A £ (G), 



L(x,G)>(KG)- 



For any cc € Xe\Ce(A, B) due to (14) 



L(x,<7 B (A,B)) = 1 

and hence there exists k, P x {$k £ C E (A, B)) > 0. Therefore for any G C Z B , As(G) > 

L(x,G) > P x (<Z> k +2 £ G) > P x ($ k £ C E {A,B),<5> k+2 £ G) > P x ($ k £ C E {A, B))^X E {G) > 0. 



Now all the conditions of Theorem 4.1 are verified. Hence, we have established that the system ( 17 1 has an invariant 



probability measure. Define a new (extended) probability space (fT, F* ,P*) as a cartesian product 

n* = Q x R, F* = F x B(R), P* = PxU, 

where U is a uniform measure concentrated on [0,1]. There exists a measurable function r : R 2 — ! 
distribution of 



such that the 



is the invariant probability measure of (17). Put 



do = (po,r(oo,u)), d t = h(d t - 1 ,et_ 1 ), t>l. 
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Then {(z t , d t )} is a strictly stationary solution of (17 1. It only remains to note that due to the definition of Xe 



a\ = z t , a t = z t + d t 



is the stationary solution of ( 10 ) with H = He and 



P(al = w ) = on 

Proof of Theorem EPl 

Let's rewrite the VGARCH evolution equations ^ and ([9| in the explicit form: 



z t = a + Pzt-i + j(e t -i - S) 2 , 
_z t =a + ,3z t _ 1+1 (e t ^zlL\z;}l>-5)\ 



t > 1, 



(26) 



where we define 



z t = of, z t = of, t > 0. 



We will consider a Markov chain {(z t ,z t )}. Define 

Xy = {(z, z)6l 2 :z>a,z>tt,z/z}. 

If (z, z) € Xy, then 

P ( *,i)((zi, £i) £ * v ) = P(z,z) [a + pz + 7(e - = a + /3z + 7 (eqz 1 / 2 ^ 1 / 2 - tf)^ = 

P (M) (/?(z - z) + 7 £oMl - zz- 1 ) + 28{z 1 l 2 z- 1 ' 2 - 1)) - o) = 0, (27) 



because the second degree polynomial with respect to £q inside the probability in (27) has at most 2 roots and the 



distribution of £o is continuous due to Condition 3.1 Similarly, for any [z,z) € Xy and t > due to induction and 
Fubini theorem 

P {z ,z){{z u zt) i X v ) = 0. 

Hence we the chain {(z t , z t )} has a modification defined on Xy, which we will consider from now on. 
We also recursively define 

hi(z,x) = a + j3z + 7(1 - 5) 2 , h t {z,xx,..., x t ) = hx{h t -i{z, xi,... ,x t -i),Xt), t>2, 

hi(z, z,x) = a + /3z + ry(xz 1/2 z~ 1/2 - S) 2 , h t (z, z,x\,...,x t ) = h\{h t -i{z, z,xi,... ,x t -i),x t ), t>2, 



so that 



z t = ht(z a ,e , . . . ,£ t _i), Zt = ht(zo,Za,Eo,...,e t -i). 
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Step 1. Fix positive real k,m,A,B and n G N. Their values will be chosen later, for now we'll just say that we 
select them in the following order: k is small enough, then n large enough, B then large enough, m large enough, and 
finally A - large enough. Define 

Rn[z,z) = E^ t ^[-log(\z n - z n \)], V v (z,z) = z + kz + mR n (z,z), z ^ z, 

C V {A,B) = {(z,z) e K 2 : z G [a,A],ze [a, A], \z-z\> S" 1 }. 
In order to check the strict drift condition, we'll demostrate that for some /i > and all (z, z) € Xy\Cy (A, B) 



E {z,S)[Vv(zi,^i)] < Vy(z,z) - fj, 
if k, m, A, B and n are chosen appropriately. First note that 

E{z,&)Zx =a + /3z + 1 {S 2 + l) } 
E(z,z)'z\ = a + fiz + 7 (d 2 + zz^ 1 ) <a + (3z + j5 2 + aT^z. 
Second, we'll show that for any (z, z) G Xy 

E (Sit) \hog(\z - z\) - log(|5i - z x \)} < M, 

where M depends only on model parameters. For any (z, z) G Xy 



(28) 



(29) 



(30) 



[- Iog(|fi - ai|)] = - log(/3) - logflf -z\)+[- log(|l + qe Q - re 2 \ 



(31) 



where 



2 7 <5 



y pz 1 / 2 [z 1 / 2 + z-V 2 ) ' 0z 
Condition X v > implies that 7 > 0, thus r > 0. Note also that both q and r are uniformly bounded. Due to Lemma 
4.1 (cj) and (31), (30) is fulfilled. Applying it together with (29) iteratively, we obtain 



where (not importantly), 



\Rn{z, z) + log(|z - z\)\ <nM*, 



M* =M + a + 7 (<5 2 + 7a~ 1 (a + 7(1 + S 2 ))) < 00. 



(32) 



(33) 



For z > A, z > z, using (30) and (29) we infer 



E( z j)[Vy(zi,zi)] = E {z j_)zi + kE( z<i )Zi - mE {Zyi ) log(|£„ - z n \) 



< 
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(q + (3z + 7(1 + S 2 )) + k (q + (3z + 7(0 1 z + S 2 )) - m logfli - z\) + mnM* 



< 



V v (z, z) + (P-l + ka~ 1 ~f)z + k(/3 - l)z + a + j{6 2 + 1) + k(a + jS 2 ) + mnM* < V v (z, z) - fi 
for any /j, > and k < (1 — P)a/ r y, 

u + a + 7((5 2 + 1) + k(a + jS 2 ) + mnM* 



A > 



k(l-p) 



(34) 



If z > A, z > z, we similarly have 



once 



E( z ,z)[V v {z 1 ,z 1 )] < V v (z,z) + (p-l + ka Y i)z + k(p - l)z + a + j(S 2 + 1) + k(a + 7<5 2 )+ 

mnM* < V v (z,z) - u 

li + a + 7((5 2 + 1) + k(a + jS 2 ) + mnM* 



fc(l - p - kar x i) ' ^ 

The case z < A, z < A is less straightforward. First, fix any n G N and assume A > (any function which grows 
quicker than linearly but slower than exponentially will work). The case of (z, z) such that 



is considered similarly, we have 



if 



\z-z\<B-\ z>e^, 



E( z ^)[V v (z 1 ,z 1 )} <V v (z,z) - u, 



(36) 



^ M + a + 7(£ 2 + 1) + kja + 7J 2 ) + mnM* 
6 - /c(l-/3-/fca- 1 7) ■ 

Consider now the case z < e^™ (and by definition of Xy \z — z\ < B~ x ). We will choose B large enough, depending on 

n. Note that 

E( z ,z)Rn{z\,zi) - i? n (z, z) = R n+ i(z,z) - R n (z,z) = 



E (z,z) log 



P - iznz~ l (e„ - 25(1 + zy 2 z- 1 /2 ) -i) 



(37) 



Let's estimate the right-hand side of (37 1 from above. Note that 



< z- 1 < a-\ < z-\l + 4 /2 C 1/2 ) _1 < 



thus due to Lemma 4.1 (c]), the family of conditional distributions 

{P M) (log |/3 - 7 £„i- 1 (e„ - 25(1 + 4 /2 C 1/2 ) _1 ) j e •) } 



(z,z)6Cv(-4,B),n6l 
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is uniformly integrable. For a fixed n, due to the fact that the function h is continuous 



„ p 



as B — > oo uniformly in (z, z) 6 (Xy\Cy(A,B)) H {z < e^™}. Therefore, due to dominated convergence theorem for 
n — > oo and B — > oo appropriately quickly, 



Slog 



-Ay. 



Finally, for large enough n and appropriately chosen B, for any (z, z) 6 (Xy\Cy(A, B)) n {z < e^™} the right-hand 



side of (37) is no greater than 



-X v /2 <0 



and for all (z, z) € (-*V\CV(A £)) n {z < e^™} 



£ (M )[VV(*i>*i)] < VV(2,z) + (/3-l + A:a- 1 7)z + A : (/?-l)i+ 
a + j(5 2 + 1) + fc(a + 7 <5 2 ) - mX y v /2 < V v (z, z) - fx, 



if only 



m > 



fx + a + 7(<? 2 + 1) + fc(a + 7<5 2 ) 



(38) 



To sum up, we have shown that for (28) to be true the constants defining the function Vy(z,z) may be chosen in the 
following order: 

1) k= (1-0)0/(27). 



2) m is large enough so that ( 38 ) holds 



3) n is large enough and B - large enough depending on n, so that (36) holds and the rhs of (37) is no greater than 



-\ y v /2 for (z, z) e (X V \C V (A, B)) n {z < e^}. 



4) A - large enough for (|35| and ( 34 ) to hold 



Thus, (28) is established. 



Step 2. Similarly to the proof of Step 2 of the Theorem 3.1 we will show now that the sets Cy(A, B) are ^-petite 
for the chain {(z t , z t )}, a = (0, 1,0,.. .) and 

dv = fxl{(z, z) e Z v }d\ v , Z v = [D, D + /j] x [D, D + fi] 

with some fx > 0, D, where Ay is Lebesgue measure on Xy. It will also ensure that Vy is unbounded off petite sets, 
since it easy to see that sets of form {VV(z, z) < x} are subsets of Cy(A, B) for large enough A, B. 
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For that, we will use Lemma [4 . 2 1 with 



k = 2, T=C V (A,B), Z = Z V , t = (z,z), f{ z ,z){x\,xi) = {h 2 {z,x-i,x 2 ),h 2 {z,z,xi,x 2 )). 
To ensure the Lemma's conditions, we will show that once D is large enough the equation 



h 2 (z,x ,xi) = z* , h 2 (z,z : x ,xi) = z* 



(39) 



on xq and x\ has a solution for (z*,z*) 6 Zy and any (z,z) £ Cy(A,B), such that x G [8,(D/3 X 7 1 ) 1 ' 2 ]. Indeed, 
there exists a continuous function xi(xq,z*), defined for large z* and any xq € [5, (-D ( 5 _1 7 -1 ) 1 ' 2 ], such that 



^(z,l0^l(%,J!*)) = Z* 



(40) 



Note that on Cy(A,B) (zjz) is uniformly separated from both and oo. Assume that z > z; the case I < z is similar. 
When x = S, h\(z,z,Xo) > H\{z,Xq) and for some /i > 

^2(2, 2,^0, #1(^0,2*)) < ft-2(z,x ,a;i)(/ii(z,a; )//i 1 (z, £,x ) 

On the other hand, when ceo = (D/3^ 1 7~ 1 ) 1 / 2 , for some > 

^i(z, z, x ) < hi(z, xq)(z/z + /1) 



and 



h 2 (z, z,x ,x-l(x , z*)) > h 2 (z, x ,xx)(z/z - fx). 



Since h 2 is a continuous function, for large enough D there's a solution (x , £1) to (39 1, such that x e [(5, (-D/3 1 7 1 ) 1 ^ 2 ]- 
Due to Lemma 4.2 for some fi > and any Q e B(M. 2 ) 



P(z,z)((z 2 ,Z 2 ) S Qn Zy) > III d\y. 



To ensure the strict drift condition (15), it only remains to show that 



sup {E( z ^[V v {zi,zi)\ - Vy(z,z)) < 00. 



It easily follows from (29) and (32 1. Thus, the correctness of (15) is established. Theorem 4.2 implies that <& is indeed 
recurrent. 



Step 3. Now, (14) and 0-irreducibility are checked in a similar fashion to the Step 3 of Theorem 3.2 Applying the 



Theorem 4.1 and (14) yields the desired result. □ 
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4.3 Proof of the case i) of Theorems 3.3 and 3.4 

The proofs for these laws of large numbers will also require some general Markov chain technique. Essentially, they are 



corollaries of theorems 3.1 and 3.2 and of corresponding Markov chains being positive Harris recurrent. 
Definition 4.2 The set A is called Harris recurrent if for all x £ A 

Q(x,A) = P($ t £ A infinitely often\§ = x) = 1. 
The Markov chain is called Harris recurrent if any set in B + is Harris recurrent. 



We will proof the case i) of both theorems simultaneously. Consider the chain {(z t ,z t )} defined either by (16 1 or 



(26 1. For such a chain, positivity was proven in theorems 3.1 and 3.2 Aperiodicity follows from the fact that 



UneNCfit™, n) = X El U ne nCv(n,n) = X v 



and petiteness of Ce{A, B), Cy(A, B). In the Step 3 of theorems |3 . 1 1 and 3.2 we showed that for A, B large enough and 



any x £ C L(x,C) = 1, where C is either C E (A,B) or C V (A,B). By (Meyn and Tweedie 2009 Proposition 9.1.1) 



this implies Harris recurrence. By (Meyn and Tweedie 2009| Theorem 13.0.1), for any x £ X 



sup |P($„ £ A\$> = x) - tt(A)\ -> 

AeB(X) 



(41) 



as n — > oo. By (Meyn and Tweedie, 2009 Theorem 17.0.1), positive Harris recurrence also implies LLN of the form 

n 

n-^fi^t)^ Ef(%) (42) 
t=i 

for any /, B|/($o)| < °°, where {$*} is a stationary version of {$*}. It remains to check that the statement we need 



is a combination of (41) and (42). Indeed, denote 



X LLN = \x£X:P[n- 1 J2 /(*t) -> E f($o) 



1=1 



= X 



By (42) and Fubini theorem applied to $o and £q, . . . £ n -i 



P($o € X LLN ) = 1, 



which implies ergodicity for the process {$(}■ By (41) and Borel-Cantelli lemma, for any x £ X 

P(3n>Q,$ n £X LLN \$ Q = x) = l. 



Therefore, for any x £ X 



P 7^ Wo) 



{=1 



$n = x \= 1 
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and for any random variable £ which is measurable with respect to <r{$t, t < 0} 



P In" 1 ->£/(^o) 



*o = £ =1- 



Setting £ = (<Tq, s 2 ), where s 2 is any starting point for of, concludes the proof. □ 



4.4 Proof of Theorem 3.3 ii) 



We will use notation from the proof of case i). It suffices to check that for the chain {(z t ,dt)}, defined in (17 1 and any 
fi > and (z, d) € Xe 

P(z,d){\dt\ > M) -> 0, t^oo. 



We will use Theorem 8.4.3 from Meyn and Tweedie (2009) in order to establish transience of the chain {(zt,dt)}. 
Denote 



v£(z,d) = i- 



1 



max(— log \d\, 1) 



For brevity, denote 



x V y — max(a;, y). 

Let us now check that for some fj, > and any (z,d), such that V£(z, d) > 1 — /x, 

S(»,d)[Vf > V£(z,d). 

Indeed, for \d\ < exp{— 1} and any z € K due to Fatou's lemma 



liminf((log|d|) 2 (E {z , d) [V£(z 1 ,d 1 )]-V£(z,d))) 

\d\-+Q 



hmmf((logM|) 2 (e [z4) - { - { ^' !]> <<-<«* I"' + <■<--.'. !VH 

(-log|d|-log|/3 + d-ie d e5|)Vl 



liminf — log \d\Ei 



(-log|/3d + e d e5|)Vl 
(-log^ + d^e^Dva+logldl) 



Um inf E, 



\d\To (1 + (log |d|)-i log |/3 + d-^eSl) V (-(log Ml)- 1 ) 

liminf£ [-logl^ + eSd-^dl] = -A^ > 0. 
|rf| — >-o 



(-log|/3 + d- 1 ed e5|)V(l + log|d|) 



> 



Therefore, (43) holds true for all small \d\ as needed. 



(43) 



As was shown during the proof of Step 2 of Theorem 3.1 the set Ce(A, B) is petite for any < A < oo, < B < oo. 



During Step 3 of the same Theorem, it was established that the chain {(zk,dk)} is V'-hreducible. The exact same 
proof of irreducibility works in the case X E < too, except for the equality L(x, Ce(A, B)) = 1 which is not true 



20 



anymore. Instead, we'll verify directly that for large enough A and B and any (z, d) € Xe there exists k, such that 
P(z.d) (( z k, dk) € Ce{A, B)) > 0. It suffices to check that for any B > 1 and large enough A there exist t, Xq, . . . , x t _i, 
such that 

(h t (zo, x ,..., x t -i), h t (d , x ,..., x t -i)) e C E (A, B). 
Indeed, for any d£R there exist xo(d),xi(d), such that 



Then for any z, d 



h 2 (d,x {d) 1 xi(d)) = 1. 



/i2fc(^zo(d))Zi(d))Zo(l),a;i(l), . . . ,x (l),xi(l)) = 1 



and 



h2k(z 1 x Q (d),xi(d),x (l),xi(l), . . . ,x (l),xi(l)) -t (3 2 (a/3 + x (l)P + xi(l)), t -t oo. 



It remains to choose any A > (3 2 (af3 + xq(1)/3 + xi(l)). Hence, the chain {(zk, dk)} is "0-irreducible. It's easy to check 
now that C E (A,B) and X E \C E (A,B) are both in B+(X E )- 



Due to (|43| and Theorem 8.4.2 from Meyn and Tweedie (2009), the chain {(z tl d t )} is transient. According to the 



Theorem 8.3.5 from Meyn and Tweedie (2009) and the fact that Ce(A,B) is petite, it is also uniformly transient. 



Finally, since for arbitrary A > 



we get 



P(z,d){\d t \ >v)< P{{zt,d t ) £ CEiA,^ 1 )) + P M (\zt\ >A)^ P(\z t \ > A), t -> 



P( z , d ){\d t \ > fi) -> 0, t^oo.D 



4.5 Proof of Theorem 3.4 ii) 



We need to check that for the chain {(z t ,d t )}, defined in (26) and any jj, > and (z,z) £ Xy 



Fix m e M. + , n 6 N and denote 



P(z,z)(\zt - z t \ > n) 0, t^-oo. 



V*(z,z) = l 



(mR n (z, z) - y/z) V 1 ' 



with R n (z, z) as defined during the Step 1 of the proof of Theorem 3.2 Let us now check that for some (i > 0, n € N, 



m £ R + and any (z, z), such that Vy(z, z) > 1 — /i, 



(44) 
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First, recall that due to (32 1 for any (z, d) £ Xy, n E N 



\Rn(zi,Zi) + log \zi - 2i| - Rn{z,z) - log \z - z\\ < 2M*n, 



(45) 



with M* as defined by (33) 



It's easy to see that for x > I and y £ 



y 



< 



y 



< 



Put 



(x + y) V 1 x .x 2 i 2 ((i + )/)V1) x 2 



d(z) = (Vi- A) VO, 



we will select A in what follows. For (z, z) such that Vy(z, z) > we have 



V^(zi,zi) > 1 



= Fy (z, z) + S n (z, z,z u zi) + T n (z,z,zi,zi), 



where 



(mRn(zi,Zi) - d(z) V y/zi) V 1 

(mR n (zi, 2i) — d(z) V J~Zi) V 1 — mR n (z, z) + y/z 



T„(z, z, zi, zi) 



S n (z,z,zi,zi) 



(mR n (z, z) - y/z) 2 
1 



mR n {z, z) — v 1 z (mR n (zi, z%) — d(z) V yfz\) V 1 
Let's estimate S n and T n separately. First, using p6|), (|45| and the inequality 



T n (z,z,zi,Si). 



Vy - vx < 



which is valid for any y > x > 0, we get 



(mRn(z, z) - y/z) 2 S n {z, z, zi,zi) < 



(mR n (zi,zi) - d(z) V y/zi - mR n (z, z) + y/zf 



< 



(46) 



(47) 



(48) 



(mRnizuZx) - d(z) V y/zj) V 1 

2m 2 (R n {z 1 ,z 1 ) - R n (z, z)f + 2(y5 - d(z) V y/z^) 2 < 
(mR n (zi, ii) — d(z) V y/zj) V 1 

4m 2 (4(M*) 2 n 2 + (log \z-z\- log - Zl \f) + 2A 2 + 2 7 (e - 5) 2 
(mRnizuZi) - d(z) V y/zj) V 1 _ " 

According to (31 ) and Lemma 4.1 (cj), the nominator (48) is uniformly integrable for (z, z) € Ay, and its denominator 
tends to infinity for a fixed eo a s 

mR n (z, z) — y/z — > +oo. 

Due to dominated convergence theorem, 



(mR n (z, i) - y/z) 2 S n {z, z, z u z x ) 
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as mRn(z, z) — yfz — > +00. 

For T n we will consider 2 cases. 



1) z < e*". Similarly to the estimation of the right-hand side of (37), when n is large enough, fi > is small enough, 
for any (z, z) such that 

R n {z,z) > n~ x , 



we have 



Therefore, for any such n, /1 



E{ z ^)[Rn{zi,h) - > A^/2. 



m>(A^/2)- 1 (V7^ko-^| + A) ) 



we have 



„ , „ ^ , ^mE[R n (z 1 ,z 1 ) ~ R n {z,z)]~ E (i) [d{z)\J y/z{\ + y/z 
E( z ,z)T n (z,z,z 1 ,z 1 ) > ; — — — - — > 



(mRn(z, z) ~ yfz) 2 
mE^lRniz^zi) - R n (z, z)] - d(z) V {yfflz + yffE\e - 6\) + y/z 



{mR n (z, z) - yfz) 2 

m\ y v /2 - ^yE\e - 6\ 
(mR n (z,z) - yfz) 2 

2) z > e^. According to j30|, (45]), Lemma [ij] |c] and ^4Tj) 



> 



> 0. 



(49) 



evtw - - w j-, mR n(zi, h) - d(z) V y/zi - mR n (z,z) + yfz -m,M - d(z) V {yfjz + yfj\s - 5\) + yfz 

ET n {Z, Z, Zl, Z\) > E ; ^ > E ; = ; > 



(mRn(z, i) - y/z) 2 

-m{2M* + M) - E{yfy\e Q - 5\) 



(mR n (z, z) - yfz) 2 



(mRn(z,z) - y/zf 



(50) 



In view of (48), (49) and (50), (44) is established. 



XXX Add the proof of psi-irreducibility. 
4.6 Auxilliary results 

The following lemmas are technical tools used in proofs of Theorems |3.1| and |3.2 



Lemma 4.1 Assume £ is a random variable with a distribution absolutely continuous with respect to Lebesgue measure 
with density h{x), such that 

sup(|a;| + l)h(x) < 00. 

a:6R 

Then 



E(-log|l + g£|) + ->0, q^O. 



(a) 
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£(-log|l + g <e|)+^0, q^oo. 

and for any C < oo and p > 1 



sup £|log|l + g£-r£ 2 || p < oo. 

M<C,0<r<C 



Proof. 



(a) If q = the left-hand side is 0. If q > 0, due to Condition 3.1 for any /x 6 (0, 1) 

c0 



E(-log\l + q^\)+ = - [ log(|l + qx\)h{x)dx 
J-lla 



„ < 

2/q 



-log(l-/x)- / log(|l + |/|)%/g)g- 1 tii/<-log(l-/i)-Af / log(l + y)h q (y)dy, 

where < < for all y £ K\{0}. Noting that h q {y) is uniformly bounded on [—2 + fj,, — fj], log(l 

integrable over the same interval and that 



/ h q (y)dy -> 0, q 

J-2+u 



concludes the proof (using a slightly modified dominated convergence theorem). The case q < is similar, 
(b) For q > and /x G (0, 1) 

£(-log|l + g£|)+ = -log(l-/x)- / " logdl + j/D^^/g)^ 1 ^ < 

J-2+fi 



log(l - (J,) - 



sup h(x) 

x£R 



,-1 ' 



q I log(\l + y\)dy ^ -log(l-/x), g ->• oo. 

-2+^1 



Since /x may be arbitrarily small, the proof for q > is thus complete. The case q < is similar. 

(c) For any |g| < C, < r < C the polynom 1 + qx — rx 2 has 2 roots, denote them a^ 1 and aj 1 . Then 

|l + gC-re 2 | = |l-oiC||l-aae|, 

and it's easy to check that 



It suffices to show that 



sup \di\ < oo, i = 1,2. 

\q\<C,Q<r<C 



sup £|log|l + g£-rr|| p < oo. 

M<C,0<r<C 



Since 

£?| log|l + qi - r£, 2 \\P < 2PE\ log |1 - ai£ 2 || p + 2| p £| log |1 - a 2 £ 2 || p , 



it is enough to check that 



sup £;|log|l-a£|| p < oo. 

\a\<C 
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Indeed, for a > due to Condition 13.1 



£|log|l -<ll p = / |log|l-02;|| p /i(a;)da;+ / | log |1 - ax\\ p h{x)dx < 

J\l-ax\<2 J\l-ax\>2 

[ \\og\y\\ p a- 1 h((l-y)a- 1 )dy + snp{x- 1 \\ogx\ p ) f (1 + a\x\)h{x)dx < 

J-2 x>2 J 

M f \l^\y\\P\l-v\- 1 dy + BM*~ 1 \^*\ p )0- + a E \€\)<°o, 

J-2 x>2 

where, once again, M = sup xeM ((\x\ + l)h(x)). The case a < is similar, and a — is obvious. □ 

Lemma 4.2 Let T be an arbitrary set and f T : M fc — > M. k be a continuously differentiate function for any r £ T . 
Assume also that for any ztZC R fe the equation 

f T (xi, ■ ■ ■ ,x k ) = z, 

has a solution 

x(r, z) = (xi(r, z), . . . , x k (r, z)), 

which is uniformly bounded for t £ T , z £ Z . 

Also assume £i, to be i.i.d. random variables with and absolutely continuous distribution whose density is 

uniformly separated from on 

{xj(r,z), j = 1, ... ,k,T £ T,z G Z). 
Put £ = . . . , Then for some fj, > and any C Q Z , t £ T 

P(f T (t)eC)>v\(C), 

where A is standard Lebesgue measure on M fc . 

Proof. Denote 1*5 (x) a L2-ball in M fe with a center in s and radius S > 0, then for small enough 1/ > and any r G T, 
z£ Z 

P (/r(0 G u«(z)) > P(£ G tw(x(r, z))) > i/A^jfxtr, z)))) = ^ fc+1 A(^(z)). (51) 
The inequality (51 1 implies that for some /1 > and any parallelepiped Ccl* 



P(/ T (£)eC)> M A(C). 

The application of monotone class theorem concludes the proof. □ 



The following is a direct corollary of Lemma 4.2 
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Lemma 4.3 In the conditions of Lemma \4-.S\ assume that 

TcTi xT 2 , 

where 71 is an arbitrary set and Ti is a measurable space and for any t\ € 71 

{t 2 G T 2 : (ti,t 2 ) € T} 
«s measurable. Also assume that for some random element x m 72, independent with 

P((n, x )eT)>p>0 

for any t± G 71- TTien /or some // > anrf any C C Z, ti G 71 

P(/ (rilX )(€)€C) >/iA(C). 
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